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ABSTRACT 


The  General  Fermat  Problem,  or  Weber  Problem,  asks  £or  a  point  that 
minimizes  a  weighted  sum  of  the  distances  to  m  given  points.  The  Weiszfeld 
Kuhn  algorithm  is  an  iterative  procedure  that  converges  to  an  optimal  point 
for  all  but  a  denumerable  number  of  starting  points.  We  give  an  amended 
version  of  the  algorithm,  that  guarantees  convergence. 
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A  NOTE  ON  THE  WEISZFELD 


ALGORITHM 


FOR  THE  GENERAL  FERMAT  PROBLEM 


Egon  Balas  and  Chang -Sung  Yu 


1.  Introduction 


The  problem  of  finding  a  point  in  the  plane  that  minimizes  the  sum  of 
distances  to  three  given  points  was  posed  by  Fermat  at  the  beginning  of  the 
17th  century,  and  solved  shortly  thereafter  by  Toricelli.  A  generalized 
version  of  this  problem,  with  important  applications  in  location  theory, 
and  usually  referred  to  as  the  General  Fermat  Problem,  or  Weber  Problem, 
is  as  follows: 

Given  m  points  a^  e  ,  called  vertices,  and  associated  weights  w^  >  0 
i  »  l,...,m,  find  a  point  x*  e  Ma  that  minimizes 


f  00  -  E  w  d  (x) , 
i-1  1  1 

where  d^x)  is  the  Euclidean  distance  between  x  and  a^  i.e.. 


d,  (x)  «  V  E  (a,  -  x.)  . 

1  j-1  J 

If  the  n  vertices  are  colllnear,  the  problem  is  a  special  case  of  the 
absolute  median  problem  in  a  tree,  solvable  in  linear  time.  So  we  assume 
the  vertices  are  not  collinear.  In  this  case  f  is  strictly  convex  and  x* 
is  unique.  Further,  f  is  differentiable  everywhere  except  at  the  vertices 
a^,  i  ■  l,...,m,  and  the  gradient  of  f  at  x  j*  a^,  i  -  l,...,m,  is 
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Vf(x) 


m  w ^ 

1-1  V*> 


(x  - 


Imposing  the  optimality  condition  Vf(x*)  ■  0  then  yields 


m  w^  /  m 

which  is  well  defined  for  x*  j*  a^,  i  *  l,...,m. 

In  1937,  Weiszfeld  [2]  gave  an  iterative  algorithm  for  the  General 
Fermat  Problem  based  on  the  above  expression  for  x*.  He  claimed  that  the 
algorithm  converges  to  x*  whenever  the  starting  point  is  not  a  vertex. 

More  recently,  Kuhn  [1]  showed  this  claim  to  be  false;  gave  a  rigorous 
analysis  of  the  problem  and  the  algorithm,  and  proved  that  a  slightly  amended 
version  of  the  latter  converges  to  x*  for  all  but  a  denumerable  number  of 
starting  points. 

Although  the  probability  of  choosing  a  bad  starting  point  is  small, 
no  fail-safe  method  is  known  for  avoiding  such  points.  The  purpose  of  this 
note  is  to  fill  in  this  gap,  and  provide  a  version  of  the  algorithm  for  which 
the  sequence  of  Iterates  is  guaranteed  to  converge  to  x*. 

2.  The  Weiszfeld-Kuhn  algorithm  and  its  properties 

The  Weiszfeld-Kuhn  algorithm  consists  of  iterating  the  mapping 
T:  x  -•  T(x) ,  where 


T(x) 


m  w^  I  m  w^ 

i-i  ipr  *4  /  ■ 


*k  ’ 


x  +  a^,  i  *  1, . . .  ,m 

x  “  *k’  • 


3 


The  essential  properties  of  the  algorithm  are  sunnnarized  below. 
For  k  *  l,...,m,  define 


“k  "  <W  (ai 

i*k 


-Vf(x), 


x  +  a^,  i  -  1, . . . ,m 


-  wk}*Rk/llRkH*  x  ”  v  k*tl . 


where  ||  *||  denotes  the  Euclidean  norm. 

While  the  gradient  of  f(x)  exists  only  for  x  +  a^  i  ■  1 . m,  R(x) 

is  defined  for  all  x  c  R  n. 

The  main  properties  of  x*  and  T  are  as  follows  (Kuhn  [1]): 

(1)  x  -  x*  if  and  only  if  R(x)  =  0. 

(2)  x*  is  in  the  convex  hull  of  the  vertices  a^. 

(3)  If  x  ■  x*,  then  T(x)  -  x.  If  x  is  not  a  vertex  and  T(x)  *  x, 
then  x  ■  x*. 

(4)  If  T(x)  f  x,  then  f(T(x))  <  f(x). 

(5)  afc  -  x*  if  and  only  if  wfe  >  HrJI. 

(6)  If  a^  f  x*,  the  direction  of  steepest  descent  of  f  from  a^  is 

Rk/IiRfcll  “ 

(7)  If  a^  j*  x*,  there  exists  6  >  0  such  that  0  <  (^(x)  <  8  implies 
d^(Ts(x))  >  5  for  some  s. 

(8)  lim  [dk(T(x))/dk(x)l  -  llRjI/v  k  "  1 . . 
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(9)  For  any  starting  point  x°,  let  xr  -  Tr(x°),  r  -  1,  2,... 

T  V 

If  no  x  is  a  vertex,  then  lim  x  =  x*. 

r-*« 

o  r  r,  oN 

(10)  For  all  but  a  denumerable  number  of  starting  points  x  ,  x  *  T  (x  ) 
converges  to  x*. 


3.  Discussion 

From  (3)  and  (4),  f(T(x))  <  f(x)  for  any  nonoptimal  x  that  is  not  a 
vertex.  So  as  long  as  the  sequence  (xr}  does  not  reach  a  vertex,  f(xr)  is 
monotone  decreasing  with  r.  On  the  other  hand,  since  T(x)  =  x  whenever  x 
is  a  vertex,  if  the  sequence  (xr}  ever  reaches  a  vertex,  it  never  leaves  it. 
Thus  convergence  to  x*  requires  the  avoidance  of  vertices.  Now  (8)  in 
conjunction  with  (5)  implies  that  for  any  x  different  from,  but  close  enough 
to,  some  vertex  ak,  d^TCx))  >  d^Cx),  !•«*•»  T(x)  is  further  from  afc  than  x. 
Furthermore,  (7)  essentially  says  that  every  vertex  a^  has  a  6-neighborhood 
N(afc,  6)  such  that,  if  the  sequence  {xr}  enters  N(ak,  6)  with  a  term  xr  f  a^, 
then  it  also  leaves  N(ak>  6).  It  was  on  these  grounds  that  Weiszfeld  claimed 
convergence  for  his  algorithm  whenever  the  starting  point  was  not  a  vertex. 

In  pointing  out  the  error,  Kuhn  showed  that  (7)  and  (8)  do  not  preclude  the 
occurrence  of  T(x)  «  a^^  for  some  x  k  N(afc,  &)•  In  other  words,  although  the 
sequence  (xr}  cannot  reach  any  vertex  a^  from  within  its  neighborhood  N(ak,  6), 
it  can  hit  upon  a^  from  outside  its  neighborhood,  and  when  that  happens,  it 
gets  stuck. 

At  first  sight,  this  problem  seems  easy  to  correct.  If  xr  =  a^,  it 
would  seem  sufficient  to  replace  a^  by  any  point  x  c  NCa^,  6) ,  x  t  a^. 
Then  by  property  (7),  there  is  an  integer  s  >  r  +  1  such  that  x8  k  N(ak,  6). 
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r+1 

However,  if  x  is  chosen  arbitrarily,  there  is  no  guarantee  that  once  the 
sequence  leaves  N(a^,  6),  it  does  not  again  hit  upon  a^.  Although  the 
probability  of  this  is  very  low,  the  possibility  of  repeatedly  hitting  the 
same  vertex  a^  cannot  be  excluded.  And,  of  course,  the  sequence  could 
"visit"  more  than  one  vertex. 

Thus  some  special  rule  is  called  for  if  one  is  to  avoid  such  occurrences. 
This  we  give  next. 

4.  A  convergent  version  of  the  algorithm 

0.  Let 


m  /  m 

Xj  "  ^i  ’  J  =  1 . 


set  r  -  0,  and  go  to  1. 

1.  If  xr  -  for  some  ke(l . m},  go  to  2.  Otherwise  let 


r+1  ®  wi  /?  wi 

*  *  z  — r  *i ' z 


mi 

Then  if  x  =  x  ,  stop:  x*  =  x.  Otherwise  set  r  *-  r  +  1  and 
go  to  1. 

2.  If  wfc  >  HrJI,  stop:  x*  «  a^.  Otherwise  find  (for  Instance, 
by  bisection)  a  scalar  \  >  0  such  that  f(afc  +  <  f(afc),  let 


r+1  , 

X  -  .k  +  XR*, 


set  r  •-  r  +  1  and  go  to  1. 

Proposition.  The  above  algorithm  converges  to  x*. 


Proof.  Step  0  chooses  the  center  of  gravity  as  a  reasonable 

starting  point.  Step  1  is  like  in  the  original  algorithm;  and  if  no  xr  is 

a  vertex,  i.e.,  if  step  2  is  never  used,  then  from  (4)  fCx1^1)  <  f(xr) 
r+1  r 

whenever  x  j4  x  ,  and  from  (9)  the  sequence  (xr}  converges  to  x*. 

If  xr  =  afc  for  some  r  and  k,  and  wfc  >  ii^ll,  then  from  (5)  x*  =  afc. 

Otherwise,  from  (6)  is  the  direction  of  steepest  descent  of  f 

from  afc;  hence  for  \  sufficiently  small,  f(ak  +  XR^)  <  f(ak).  Thus  if 
r  s 

x  *  a^  is  not  optimal,  f(x  )  <  fCa^)  for  all  s  >  r,  and  a  given  vertex 
a^  can  appear  in  the  sequence  {xr}  at  most  once.  This,  together  with 
(9),  proves  that  the  sequence  {xr}  converges  to  x*.|| 

A  possible  alternative  is  to  use  as  starting  point  x°  =  a^,  where 
k  is  defined  by 


f(afc)  *  min  f(a1). 


In  this  case  step  2  is  used  only  once,  and  for  the  rest  of  the  time 
the  algorithm  iterates  step  1.  This  starting  solution  has  a  higher  cost, 
but  may  sometimes  save  on  the  number  of  subsequent  iterations. 
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